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TITLE OF THE INVENTION 
IMAGE SENSING APPARATUS, IMAGE SENSING METHOD, 
RECORDING MEDIUM, AND PROGRAM 

5 FIELD OF THE INVENTION 

The present invention relates to an image sensing 
apparatus and, more particularly, to an image sensing 
apparatus having a removable light -reducing optical 
filter, an image sensing method, a recording medium, 
10 and a program. 

BACKGROUND OF THE INVENTION 

In an image sensing apparatus such as a digital 
camera, only an aperture mechanism for changing the 

15 aperture diameter is conventionally set. If the 

aperture is stopped down too much in order to widen the 
photographing brightness range up to a bright object, 
so-called diffraction occurs, decreasing the 
resolution. To solve this, there is recently provided 

20 an image sensing apparatus having an ND (Neutral 

Density) filter as a removable light-reducing optical 
filter. The ND filter is an optical filter with 
nonselective transmittance that almost uniformly 
transmits (reduces) wavelengths in the visible spectra 

25 of a beam. 

In the signal processing circuit of the image 
sensing apparatus that generates image data, signal 
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processing based on the brightness value for forming an 
image on an image sensing element is not changed in 
accordance with insertion/removal of the ND filter, 
posing the following problems, 
5 In general, a brightness value Bv is calculated 

as a value obtained by subtracting the speed value (Sv) 
of an image sensing element from the sum of the 
aperture value (Av) and time value (Tv): 

Bv = Av + Tv - Sv . . . ( 1 ) 

10 For example, assuming that correct exposure can 

be obtained at an F-number of F5.6 (Av =5), a shutter 
speed of 1/1000 (Tv = 10), and film speed of ISO 100 
(Sv = 5), the brightness value Bv = 5 + 10 - 5 = 10 is 
calculated from equation (1). The image sensing 
15 apparatus transfers the brightness value calculated 
using equation (1) to a circuit block which performs 
various signal processes on the basis of the brightness 
value. The circuit block includes a WB (White Balance) 
processing block which follows a change in color 
20 temperature, and an exposure value setting calculation 
block which calculates an aperture value, shutter 
speed, and the like to set an exposure value. With 
these blocks, the image sensing apparatus realizes an 
automatic white balance function, automatic exposure 
25 function, and the like. 

When the ND filter is inserted, a conventional 
image sensing apparatus does not consider the influence 
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of the inserted ND filter in calculating the brightness 
value (or exposure value). For example, assuming that 
correct exposure is obtained at the neutral density ND 
of the inserted ND filter = 3, the F-number and shutter 
5 speed are F5.6 (Av = 5) and 1/128 (Tv =7), 

respectively. The image sensing apparatus calculates 
the brightness value Bv =5+7-5=7 in accordance 
with equation (1). That is, the image sensing 
apparatus determines that the brightness value has 
10 merely decreased (without using any ND filter), and 
thus transfers the brightness value to the WB 
processing block or exposure value setting calculation 
block. 

A concrete example of WB processing will be 
15 explained with reference to Fig. 4. Fig. 4 is a graph 
showing conventional WB processing. In Fig. 4, the 
ordinate represents a fluorescent lamp degree Cy which 
is a value representing the degree of possibility that 
the light source is a fluorescent lamp. The abscissa 
20 represents a color temperature Cx. The curve in Fig. 4 
is a WB white axis which is a target line to be 
followed upon a change in color temperature. The 
dotted line in Fig. 4 represents a WB setting range 
which sets a range where the WB white axis is followed. 
25 The WB processing block generally uses the brightness 
value Bv in photographing as one control parameter. 
For example, photographing at a large brightness value 
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Bv is determined as outdoor photographing, and WB 
processing is so restricted as to cope with a low color 
temperature. To the contrary, photographing at a small 
brightness value Bv is determined as indoor 
5 photographing is determined as indoor photographing in 
which an object is illuminated with tungsten light or a 
fluorescent lamp, and WB processing is so restricted as 
to cope with a high color temperature. In this way, 
the influence of a color object is suppressed. In WB 

10 processing based on the brightness, if the calculation 
value of the brightness value Bv changes for the same 
object, WB processing also changes, failing to obtain 
image data by WB processing optimal for the object. 
A concrete example of exposure value setting 

15 processing will be explained with reference to Fig. 5. 
Fig. 5 is a graph showing conventional exposure value 
setting processing. In Fig. 5, the ordinate represents 
the brightness of an adjusted image which is the 
exposure value of the image sensing apparatus. The 

20 abscissa represents the brightness value Bv. In 

exposure value setting processing, as shown in Fig. 5, 
high-brightness luminance increasing processing of 
increasing the exposure value for a large brightness 
value Bv (e.g., Bv value = 8 to 9 or more) is 

25 performed. More specifically, when the brightness 
value Bv is large, an atmospheric scene is often 
obtained by relatively brightly reproducing an image at 
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a summer seaside, winter skiing ground, or the like. 
For this reason, the exposure value is set slightly 
large for a large brightness value Bv, as indicated by 
the arrow in Fig. 5. If the calculation value of the 
5 brightness value Bv changes for the same object, the 
high-brightness luminance increase amount also changes. 
Image data by exposure value setting processing optimal 
for the object cannot be attained. 

As described above, if the calculation value of 

10 the brightness value Bv changes upon insertion/removal 
of the optical filter (ND filter) even for the same 
object, processes using the brightness value Bv, such 
as generation of an optical system control signal and 
control of signal processing in a signal processing 

15 circuit, are no longer optimal for the object. 



SUMMARY OF THE INVENTION 
The present invention has been made to overcome 
the conventional drawbacks, and has as its object to 
20 provide an image sensing apparatus capable of sensing 
an image in consideration of the influence of 
inserting/removing an optical filter, an image sensing 
method, a recording medium, and a program. 

To solve the above problems, according to the 
25 first aspect of the present invention, an image sensing 
apparatus having at least a filter insertion/removal 
device which inserts and removes an optical filter for 
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reducing a light quantity to an image sensing element 
serving as an optical system is characterized by 
comprising a signal processing device which performs 
signal processing so as to generate image data from an 
5 image sensing signal output from the image sensing 
element, a brightness value calculation device which 
calculates a first brightness value representing a 
brightness of part or all of an object which is imaged 
on the image sensing element, a brightness value 

10 correction device which calculates a second brightness 
value by correcting the first brightness value on the 
basis of a light reduction amount generated by 
inserting the optical filter by the filter 
insertion/removal device, and a control device which 

15 controls the optical system and/or the signal 

processing in the signal processing device by using the 
second brightness value. 

According to the second aspect of the present 
invention, an image sensing method using an image 

20 sensing apparatus having at least a filter 

insertion/removal device which inserts and removes an 
optical filter for reducing a light quantity to an 
image sensing element serving as an optical system is 
characterized by comprising a first step of calculating 

25 a first brightness value representing a brightness of 
part or all of an object which is imaged on the image 
sensing element, a second step of calculating a second 
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brightness value by correcting the first brightness 
value calculated in the first step on the basis of a 
light reduction amount generated by inserting the 
optical filter by the filter insertion/removal device, 
5 and a third step of controlling, by using the second 
brightness value calculated in the second step, the 
optical system and/or signal processing of generating 
image data from an image sensing signal output from the 
image sensing element . 

10 According to the third aspect of the present 

invention, there is provided a computer-readable 
recording medium which records a program for 
controlling an image sensing apparatus having at least 
a filter insertion/removal device which inserts and 

15 removes an optical filter for reducing a light quantity 
to an image sensing element serving as an optical 
system, the program causing a computer in the image 
sensing apparatus to execute a first step of 
calculating a first brightness value representing a 

20 brightness of part or all of an object which is imaged 
on the image sensing element, a second step of 
calculating a second brightness value by correcting the 
first brightness value calculated in the first step on 
the basis of a light reduction amount generated by 

25 inserting the optical filter by the filter 

insertion/removal device, and a third step of 
controlling, by using the second brightness value 
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calculated in the second step, the optical system 
and/or signal processing of generating image data from 
an image sensing signal output from the image sensing 
element . 

5 According to the fourth aspect of the present 

invention, there is provided a program which controls 
an image sensing apparatus having at least a filter 
insertion/removal device which inserts and removes an 
optical filter for reducing a light quantity to an 

10 image sensing element serving as an optical system, the 
program causing a computer in the image sensing 
apparatus to execute a first step of calculating a 
first brightness value representing a brightness of 
part or all of an object which is imaged on the image 

15 sensing element, a second step of calculating a second 
brightness value by correcting the first brightness 
value calculated in the first step on the basis of a 
light reduction amount generated by inserting the 
optical filter by the filter insertion/removal device, 

20 and a third step of controlling, by using the second 
brightness value calculated in the second step, the 
optical system and/or signal processing of generating 
image data from an image sensing signal output from the 
image sensing element. 

25 According to the image sensing apparatus, image 

sensing method, recording medium, and program of the 
present invention, the first brightness value 
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representing the brightness of part or all of an object 
which is imaged on the image sensing element is 
calculated. The second brightness value is calculated 
by correcting the calculated first brightness value on 
5 the basis of the light reduction amount generated by 
inserting the optical filter. Control of the optical 
system and/or control of signal processing of 
generating image data from an image sensing signal 
output from the image sensing element is performed 

10 using the second brightness value. An image can be 

sensed in consideration of the light reduction amount 
generated by inserting the optical filter. That is, an 
image can be sensed in consideration of the influence 
of inserting/removing the optical filter. 

15 Other objects and advantages besides those 

discussed above shall be apparent to those skilled in 
the art from the description of a preferred embodiment 
of the invention which follows. In the description, 
reference is made to accompanying drawings, which form 

20 a part hereof, and which illustrate an example of the 
invention. Such example, however, is not exhaustive of 
the various embodiments of the invention, and therefore 
reference is made to the claims which follow the 
description for determining the scope of the invention. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing the arrangement 
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of an image sensing apparatus according to an 
embodiment of the present invention; 

Fig. 2 is a flow chart showing photographing 
operation when an ND filter is ON in an image sensing 
5 apparatus 100 shown in Fig. 1; 

Figs. 3A and 3B are views showing a concrete 
example when the first brightness value is corrected by 
processing of a brightness value correction unit 121 
shown in Fig. 1; 
10 Fig. 4 is a graph showing conventional WB 

processing; and 

Fig. 5 is a graph showing conventional exposure 
value setting processing. 



15 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

A preferred embodiment of the present invention 
will be described below with reference to the 
accompanying drawings . 

Fig. 1 is a block diagram showing the arrangement 

20 of an image sensing apparatus according to the 
embodiment of the present invention. In Fig. 1, 
reference numeral 100 denotes an image sensing 
apparatus such as a digital still camera which has a 
function of inserting and removing an ND filter 

25 (optical filter) 114 for reducing the light quantity to 
a CCD (Charge Coupled Device) image sensing element 101 
(to be described later) serving as an optical system. 
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The image sensing apparatus 100 also has an automatic 
white balance function and automatic exposure control 
function. The internal arrangement of the image 
sensing apparatus 100 will be explained, 
5 The CCD image sensing element 101 is a 

semiconductor light-receiving element which converts 
light into an electrical signal and outputs a CCD 
output signal (image sensing signal)- Reference 
numeral 102 denotes a CDS (Correlated Double 

10 Sampling) -A/D converter which samples a CCD output 
signal (analog signal) output from the CCD image 
sensing element 101 and converts the signal into image 
sensing data (digital signal). Reference numeral 103 
denotes a memory which is a recording medium for 

15 temporarily saving the above-mentioned image sensing 
data, and data during processing and image data 
processed by a JPEG processing circuit 104 and DSP 
circuit 105 (to be described later) under the control 
of a memory controller 106 (to be described later). 

20 The JPEG (Joint Photographic Experts Group) processing 
circuit 104 performs JPEG compression processing for 
image data (uncompressed) input from the memory 
controller 106 (to be described later), and outputs the 
JPEG-compressed image data (to be referred to as JPEG 

25 image data hereinafter). 

The DSP (Digital Signal Processing) circuit 105 
performs signal processing such as luminance signal 
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processing and color signal processing on the basis of 
image sensing data input from the memory controller 106 
(to be described later), and outputs image data 
(uncompressed) . 
5 The memory controller 106 controls the data flow 

via the memory 103 by storing image sensing data input 
from the CDS-A/D circuit 102 in the memory 103 or 
storing in the memory 103 image data during processing 
or image data processed by the JPEG processing circuit 

10 104 or DSP circuit 105. Reference numeral 107 denotes 
a D/A circuit which converts image data output from the 
memory controller 106 into an analog video signal. 
Reference numeral 108 denotes a liquid crystal display 
which displays an image on the basis of the analog 

15 video signal output from the D/A circuit 107. The 
liquid crystal display 108 displays an object image 
currently formed on the image sensing plane of the CCD 
image sensing element 101 when the image sensing 
apparatus 100 is in the photographing mode, and 

20 displays the reproduced image of image data which was 

photographed in the past and is stored in a card memory 
111 (to be described later) when the image sensing 
apparatus 100 is in the reproduction mode. 

Reference numeral 110 denotes a system controller 

25 (control device) which controls the whole image sensing 
apparatus 100. The system controller 110 comprises a 
plurality of processing units which realize the 



- 12 - 



CFM03219/P203-0359 



automatic white balance processing function and 
automatic exposure control processing function. These 
processing units will be described in detail. The card 
memory 111 is a recording medium which stores final 
5 image data (JPEG image data described above). The card 
memory 111 is preferably a nonvolatile memory which 
allows the system controller 110 to write and read out 
JPEG image data and is detachable from the image 
sensing apparatus 100. 

10 Reference numeral 112 denotes an FROM which is a 

recording medium for storing firmware data. Reference 
numeral 113 denotes a shutter button for designating 
the photographing timing of the image sensing apparatus 
100 as a digital still camera. Reference numeral 114 

15 denotes an ND filter insertion/removal switch which 

controls an ND filter mechanism (to be described later) 
so as to insert the ND filter into and remove it from 
the optical axis of the optical system. The ND filter 
is inserted (to be referred to as ND filter is ON 

20 hereinafter) when the ND filter insertion/removal 

switch 114 is ON, and is removed (to be referred to as 
ND filter is OFF hereinafter) when the switch 114 is 
OFF. 

Reference numeral 115 denotes an optical system 
25 which comprises a lens 116 (to be described later) and 
the like, and forms an object image on the image 
sensing plane of the CCD image sensing element 101. 
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Reference numeral 117 denotes an aperture & control 
mechanism (to be referred to as an aperture mechanism 
117 hereinafter) which adjusts the quantity of light 
passing through the lens 116 by the aperture. 
5 Reference numeral 118 denotes an ND filter & 

insertion/removal mechanism (to be referred to as an ND 
filter mechanism 118 hereinafter) which inserts /removes 
an ND filter for reducing the light quantity to the CCD 
image sensing element 101. Reference numeral 119 
10 denotes a shutter & control mechanism (to be referred 
to as a shutter mechanism 119 hereinafter) which 
controls a time during which an object image is formed 
on the CCD image sensing element 101 by opening/closing 
the shutter. The lens 116, aperture mechanism 117, ND 
15 filter mechanism 118, and shutter mechanism 119 

constitute the optical system 115 of the image sensing 
apparatus 100. but the optical system 115 is not 
limited to them. For example, the shutter mechanism 
119 may be omitted, and an electronic shutter which 
20 controls the charge storage time in the CCD image 
sensing element 101 may be adopted. 

The processing units of the system controller 110 
will be described. Reference numeral 120 denotes a 
brightness value calculation unit which calculates the 
25 first brightness value Bv by using the above -described 
equation (1) based on the aperture value Av determined 
in accordance with the aperture diameter of the 
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aperture mechanism 117, the time value Tv determined in 
accordance with the shutter speed of the shutter 
mechanism 119, and the speed value Sv of the CCD image 
sensing element 101. 
5 Reference numeral 121 denotes a brightness value 

correction unit which calculates the second brightness 
value Bv' by correcting the first brightness value Bv 
calculated by the brightness value calculation unit 120 
on the basis of the light reduction amount (in this 

10 embodiment, neutral density ND = 3) generated when the 
ND filter insertion/removal switch 114 is turned on and 
the ND filter mechanism 118 inserts the ND filter into 
the optical path. When the ND filter is removed, the 
brightness value correction unit 121 directly outputs 

15 the first brightness value Bv calculated by the 
brightness value calculation unit 120 without 
correcting the first brightness value Bv. The system 
controller 110 uses the first brightness value Bv or 
second brightness value Bv' for white balance 

20 processing or exposure value setting calculation 
processing. 

Reference numeral 122 denotes a WB control unit 
which outputs a white balance control value so as to 
perform desired white balance processing in color 
25 signal processing by the DSP circuit 105 on the basis 
of the first brightness value Bv output from the 
brightness value calculation unit 120 or the second 
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brightness value Bv' output from the brightness value 
correction unit 121 and the balance of R, G, B values 
of image data. The DSP circuit 105 executes white 
balance processing on the basis of the white balance 
5 control value. 

Reference numeral 123 denotes an exposure value 
setting calculation unit which outputs a control signal 
for controlling the optical system 115 in accordance 
with the first brightness value Bv output from the 

10 brightness value calculation unit 120 or the second 

brightness value Bv' output from the brightness value 
correction unit 121 and the exposure value of the CCD 
image sensing element 101 and controlling the exposure 
value to the CCD image sensing element 101. The 

15 exposure value of the CCD image sensing element 101 is 
calculated by the system controller 110. 

Each processing unit in the system controller 110 
in Fig. 1 may be implemented by dedicated hardware. 
Alternatively, the processing unit may be constituted 

20 by a memory and CPU, and a program for realizing the 

function of the processing unit may be loaded into the 
memory to realize the function. 

The memory is comprised of a nonvolatile memory 
(e.g., hard disk device, magnetooptical disk device, or 

25 flash memory), a read-only recording medium (e.g., a 
CD-ROM), a volatile memory (e.g., RAM (Random Access 
Memory)), or a computer-readable/writable recording 
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medium as a combination of them. 

Photographing operation (when no ND filter is 
inserted) of the image sensing apparatus 100 will be 
described. That is, the operation of the image sensing 
5 apparatus 100 when the shutter button 113 is pressed 
will be explained. An object image is formed on the 
image sensing plane of the CCD image sensing element 
101 via the optical system 115. The exposure value is 
controlled to a proper value by the system controller 

10 110 by adjusting the light quantity by the aperture 

mechanism 117 and controlling the charge storage time 
by the shutter mechanism 119 in photoelectric 
conversion of the CCD image sensing element 101. An 
electrical signal generated by photoelectric conversion 

15 in the CCD image sensing element 101 is output as a CCD 
output signal to the CDS-A/D circuit 102. The CDS-A/D 
circuit 102 samples the input CCD output signal, 
converts it into a digital signal (to be referred to as 
image sensing data hereinafter) , and outputs the 

20 digital signal to the memory controller 106. 

The memory controller 106 saves one image of 
input image sensing data (image of one frame) in the 
memory 103. The memory controller 106 reads out image 
sensing data from the memory 103, and inputs it to the 

25 DSP circuit 105. The DSP circuit 105 performs signal 
processing for the image sensing data, and outputs 
image data containing a pixel value which specifies the 
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10 



brightness and color of each pixel. Note that the 
pixel value is data of each pixel which constitutes 
uncompressed image data formed from the luminance and 
color difference data or from R, G, and B values. The 
DSP circuit 105 executes white balance processing in 
accordance with a control signal from the WB control 
unit 122 of the system controller 110. 

The memory controller 106 supplies the image data 
output from the DSP circuit 105 to the liquid crystal 
display 108 via the D/A circuit 107. As a result, an 
image photographed by correct exposure and correct 
white balance is displayed on the liquid crystal 
display 108. The user of the image sensing apparatus 
100 can confirm the sensed image. 
15 Also, the memory controller 106 supplies the 

image data output from the DSP circuit 105 to the JPEG 
circuit 104. The JPEG circuit 104 compresses the image 
data output from the DSP circuit 105. and outputs the 
JPEG image data. The system controller 110 stores the 
JPEG image data output from the JPEG processing circuit 
104 in the card memory 111 via the memory controller 

106 and an I/F. 

The exposure value setting calculation unit 123 
calculates setting values for aperture control by the 
25 aperture mechanism 117 and shutter control by the 

shutter mechanism 119 in accordance with the exposure 
value calculation processing result of the system 



20 
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10 



controller 110. The system controller 110 generates 
and outputs an aperture control signal for controlling 
the aperture mechanism 117. a shutter control signal 
for controlling the shutter mechanism 119, and a driver 
signal for controlling a CCD driver circuit which 
drives the CCD image sensing element 101. The system 
controller 110 also controls the memory controller 106. 

As described above, the image sensing apparatus 
100 generates JPEG image data at a proper exposure 
value and white balance in response to pressing of the 
shutter button 113, and stores the JPEG image data in 
the card memory 111. 

Photographing operation when the ND filter is ON 
in the image sensing apparatus 100 shown in Fig. 1 will 
15 be explained with reference to the accompanying 
drawings . 

Fig. 2 is a flow chart showing photographing 
operation when the ND filter is ON in the image sensing 
apparatus 100 shown in Fig. 1. The user of the image 
sensing apparatus 100 turns on the ND filter 
insertion/removal switch 114. The system controller 
110 which has received an ND filter ON command from the 
ND filter insertion/removal switch 114 controls the ND 
filter mechanism 118 to insert the ND filter into the 
optical axis of the optical system 115 (step SI). This 
reduces the light quantity which reaches the CCD image 
sensing element 101. At this time, the system 



20 



25 
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controller 110 controls the optical system 115 so as to 
keep the exposure value constant. 

The brightness value calculation unit 120 
calculates the first brightness value Bv by using 
5 equation (1) and the aperture value Av, time value Tv, 
and speed value Sv which can be specified from the 
state of the optical system 115 (step S2). In order to 
correct a decrease in light quantity caused by 
insertion of the ND filter into the optical axis, the 
10 brightness value correction unit 121 calculates the 
second brightness value Bv' by correcting the first 
brightness value Bv calculated by the brightness value 
calculation unit 120 on the basis of the light 
reduction amount generated by the inserted ND filter: 
15 Bv' = Bv - (-ND) (2) 

where the variable ND is the neutral density of the ND 
filter. 

The exposure value setting calculation unit 123 
calculates the setting of the exposure value on the 

20 basis of the second brightness value Bv' calculated by 
the brightness value correction unit 121 so as to 
attain an exposure value having a relation as shown in 
Fig. 5. The system controller 110 controls the optical 
system 115 in accordance with the exposure value 

25 setting calculated by the exposure value setting 

calculation unit 123. and controls the exposure value 
of the CCD image sensing element 101 to a value which 
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considers the second brightness value (step S4). More 
specifically, the image sensing apparatus 100 can 
appropriately execute high-brightness luminance 
increasing processing as shown in Fig. 5 regardless of 
5 whether the ND filter is ON /OFF . The WB control unit 
122 calculates a white balance control value shown in 
Fig. 4 on the basis of the second brightness value Bv' 
calculated by the brightness value correction unit 121. 
When the user presses the shutter button 113, an 

10 object image is formed on the image sensing plane of 

the CCD image sensing element 101 at the exposure value 
set in step S4 under the control of the system 
controller 110 (step S5). At this time, the CCD image 
sensing element 101 outputs a CCD output signal 

15 corresponding to the object image formed on the image 
sensing plane. The CDS-A/D circuit 102 converts a CCD 
output signal into image sensing data. The DSP circuit 
105 performs, via the memory controller 106 and memory 
103, signal processing (luminance signal processing and 

20 color signal processing) of converting image sensing 
data into image data. At this time, the DSP circuit 
105 executes white balance processing on the basis of 
the white balance control value calculated by the WB 
control unit 122 (step S6). 

25 The JPEG processing circuit 104 performs JPEG 

compression processing for image data which is output 
from the DSP circuit and input via the memory 
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controller 106, and outputs JPEG image data (step S7 ) . 
The system controller 110 writes the JPEG image data 
output from the JPEG processing circuit 104 in the card 
memory 111 via the memory controller 106 (step S8). As 
described above, the image sensing apparatus 100 can 
calculate a proper brightness value regardless of 
insertion/removal of the ND filter. White balance 
processing and exposure value setting processing using 
the brightness value can be performed more accurately. 
Concrete examples of processes in step SI to S3 

will be described. 

Figs. 3A and 3B are views showing a concrete 
example when the first brightness value is corrected by 
processing of the brightness value correction unit 121 
shown in Fig. 1. Assume that correct exposure is 
obtained at an F-number of F5.6 (aperture value Av = 
5), a shutter speed of 1/1000 (time value Tv = 10), and 
film speed of ISO 100 (speed value Sv = 5) in an ND 
filter "OFF" state, as shown in Fig. 3A. In this case, 
the brightness value calculation unit 120 calculates 
the first brightness value Bv of an object 200 = 5 + 10 
. 5 = 10. Since the ND filter is OFF, the brightness 
value correction unit 121 outputs the first brightness 
value Bv without any correction. The first brightness 
value Bv is used in processes by the WB control unit 
122 and exposure value setting calculation unit 123. 

As shown in Fig. 3B, the ND filter is set ON by 
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the ND filter mechanism 118 for the same object 200 
(step SI). Because of the neutral density of the ND 
filter = 3, the system controller 110 controls the 
optical system 115 so as to attain a proper exposure 
5 value, thereby obtaining an F-number of F5.6 (aperture 
value Av = 5) and a shutter speed of 1/128 (time value 
Tv = 7). The brightness value calculation unit 120 
calculates the first brightness value Bv of the object 
200 =5+7-5=7 in accordance with equation (1) 

10 (step S2) . 

Because of the neutral density = 3, the 
brightness value correction unit 121 calculates the 
second brightness value Bv 1 =7- (-3) =10 by 
correcting the first brightness value Bv = 7 calculated 

15 by the brightness value calculation unit 120 (step S3). 

As described above, when the ND filter is ON, the 
brightness value correction unit 121 can calculate the 
second brightness value Bv 1 = 10 which is corrected to 
the same value as the first brightness value Bv = 10 

20 obtained when the ND filter is OFF. The WB control 
unit 122 and exposure value setting calculation unit 
123 can white balance control and exposure value 
setting using a correct brightness value regardless of 
whether the ND filter is ON/OFF. Since the calculated 

25 value of the brightness value Bv does not change 

between the n ON n and "OFF" states of the ND filter for 
the same object, image data generated by the image 
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sensing apparatus 100 via exposure value setting and 
white balance processing does not change. 

in the above-described embodiment, the image 
sensing apparatus 100 is a digital still camera. 
5 However, the present invention is not limited to this, 
and may be preferably applied to a video camera or a 
camera for a personal computer. The image sensing 
element is not limited to the above-mentioned CCD image 
sensing element, and the image sensing apparatus may 
10 adopt a CMOS image sensor or the like. The 

above-described embodiment employs an ND filter as an 
optical filter, but the present invention is not 
limited to this. When another type of optical filter 
is used, the influence of the optical filter on 
15 calculation of the brightness value Bv is corrected by 
the brightness value correction unit 121. 

The object of the present invention is also 
achieved when a recording medium (or storage medium) 
which stores a program for realizing the functions of 
20 the above-described embodiment is supplied to an image 
sensing system or image sensing apparatus, and the 
computer of the image sensing system or image sensing 
apparatus reads out and executes the program stored in 
the recording medium. The functions of the 
25 above-described embodiment are also realized when an OS 
(Operating System) or the like running on the computer 
performs part or all of actual processing on the basis 
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of the instructions of the program read ont by the 
computer . 

The embodiment of the present invention has been 
described in detail above with reference to the 
5 accompanying drawings. However, a practical arrangement 
la „„t limited to the embodiment, and also includes a 
design or the like which does not depart from the spirrt 
and scope of the present invention. 

As has been described above, according to the 
0 image sensing apparatus, image sensing method. 

recording medium, and program of the embodiment, the 
first brightness value representing the brightness of 
part or all of an object which is imaged on the image 
sensing element is calculated. The second brightness 
15 value is calculated by correcting the calculated first 
hrightness value on the basis of the light reduction 
amount generated by inserting the optical filter, 
control of the optical system and/or control of signal 
processing of generating image data from an image 
20 sensing signel output from the image sensing element rs 
performed using the second brightness value. An image 
can be sensed in consideration of the light reduction 
amount generated by inserting the opticel filter. In 
other words, an image can be sensed in consideration of 
25 the influence of inserting/removing the optical filter. 
The same image can be generated regardless of 
insertion/removal of the optical filter. 
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The present invention is not limited to the above 
embodiment and various changes and modifications can be 
made within the spirit and scope of the present 
invention. Therefore, to apprise the public of the 
5 scope of the present invention the following claims are 
made . 
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